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Preferential  Factors  in  Order  of  Operations 


R.    A.    Avner 


Abstract 


An  experiment  was  designed  to  uncover    (1)  preferences  in 
order  of  operations  which   7th-grade  children  posess  before 
instruction  and    (Z)  the  extent  to  which  variable  factors  in 
expressions  like  '5+3  X  8'  affect  their  performance.     Fifteen 
of    38    subjects  exhibited    1    of    Z    stable  "rules"   in  the  first    10 
of    40    trials;   3Z    exhibited    1    of    5    in  the  last    10.     Two"  rules", 
multiplication  first  and  a    left-to-right   order,    predominated. 
Anova  revealed  that  spacing  within  the  expression  interacted 
strongly  with  the  tendency  to  work  from  left  to  right.     A 
byproduct  finding:    confusion  Of  multiplication  signs  with  addi- 
tion signs  occurred  in  about    1    trial  in    10,    but  the  frequency 
is   reduced  about    50%    when  the  dot  is  used  as  a  multiplication 
sign  rather  than  the  cross.' 


Introduction 
It  is  not  unusual  for  teachers  to  find  college  freshmen  who  seem  to  be 
unaware  that  a  convention  exists  for  order  of  operations  in  expressions   such 
as    (*)    in  which  multiplication  appears  with  addition.      The  surprise  which  these 

5+3x8  (*) 

students  show  when  the  "ambiguity"  of  such  an  expression  is  demonstrated 
suggests  an  interesting  possibility.     In  order  for  an  expression  to  appear  ambigu- 
ous,   more  than  one  simplification  must  be  evident.     If  only  one  solution  is  evi- 
dent to  a  student,    it  is  possible  that  he  is  either  acting  under  an  idiosyncratic 
set  of  rules  of  order  of  operation  (which  nnay  or  may  not  coincide  with  the 
conventional  "Multiplication  before  Addition  Order"),    or  he  is  under  the 
impression  that  associativity  holds  for  all  operations.     In  the  first  case  no 
ambiguity  would  result  because  the  idiosyncratic  rule  used  would  permit  only 
one  method  of  solution,    as  does  the  standard  rule  of  order  of  operations.     In  the 
second  case  the  student  would  admit  that  more  than  one  method  of  solution  was 
possible  but  would  assume  that  all  of  these  produced  the  sanne   result. 

The  experiment  reported  in  this  paper  was  designed  to  detect  preferences 
for  order  of  operations  and  to  determine  the  factors  involved  in  the  rules  for 
order  of  operations  which  are  used  by  individuals  but  which  are  not  based  on 
instruction  in  the  usual  order  of  operations  convention.      Typically,    entering 
seventh  graders  have  seen  indicated  sums  and  indicated  products  written  in 
horizontal  form  but  have  not  mastered  the  convention  for  order  of  operations 
for  expressions  such  as    ('!=)    (although  some  of  them  have  encountered  it). 
"Average"   seventh  graders  were  selected  as  subjects  in  an  experiment  con- 
ducted during  the  first  month  of  school,    before  they  had  received  any  instruction 
on  order  of  operations. 


Experimental  Design 

The  experiment  reported  in  this  paper  was  designed  to  detect  untaught 
preferences  for  order  of  operations  and  to  deternnine  factors  involved  in  the 
formation  of  such  rules.      Display    {■')    is  an  example  of  such  an  expression. 
Four  different  factors  were  varied  to  determine  possible  effects  on  preference 
in  order  of  operations:    (1)  order  of  presentation,    i.e.,    the  multiplication  sign 
preceded  the  addition  sign  or  vice  versa,     (Z)  relative  spacing,    i.e.,    the  dis- 
tance between  the  centers  of  the    1st  and    Znd   numerals  and  the  distance  between 
the  centers  of  the    Znd   and   3rd  niinnerals  were  in  the  ratio    7:3,    3  :Z,    1:1, 
Z  :  3,    or     3:7,     (3)  form  of  multiplication  sign  used,    either  "  X"  or  "•  ",    and 
(4)  relative  difficulty  of  the  multiplication  and  the  addition.     With  respect  to  the 
latter  factor  an  operation  of  either  kind  was  defined  as  relatively  "easy"  when 
the  sum  of  operands  was    10    or  less  and  "difficult"  when  the  sum  of  operands 
exceeded    10.     Exactly  one  of  the  two  operations  was  always  in  the  difficult 
category.      Thus  in  expression   (*)    the  addition,    5+3,    would  be  considered 
"easy"  and  the  nnultiplication,    3x8,    "difficult".     It  should  be  noted  that  this 
definition  applies  only  to  that  operation  which  the  student  performs  first. 

When  an  expression  such  as    (*)    is  considered  as  a  whole,    the  use  of  the 
conventional  order  will  insure  that  the  smaller  of  the  two  answers  will  be  found. 
The  assumption  was  made  that,    of  the  computations  the  student  must  perform  in 
simplifying  an  expression,    only  the  difficulty  of  the  first  would  influence  his 
choice  of  the  order  in  which  to  compute.     If  this  assumption  is  true,    the 
larger  answer  and  possibly  greater  difficulty  encountered  by  adding  first  would 
not  influence  the  student's  preference. 


Since    40    combinations  of  the  factors  mentioned  are  possible,    this  was  the 
minimum  nunriber  of  trials  necessary  for  a  complete  factorial  experimental 
design.     Accordingly,    40    problems  of  the  forms   shown  in  Fig.    1    were  written 
and  reproduced  on    3"x  5"  cards.     (The  complete  set  is  reproduced  in 
Appendix   A.) 

AXB+C  A-B  +  C 

A+BXC  A+B«C 

Fig.    1 

Problem  Forms 

In  the  expressions  presented  to  the  students  'A',    'B',    and  '  C  were  replaced 
by  different  numerals  ranging  from  '2'   through  '9'.      Ten  problems  were  made  up 
in  each  of  the  four  forms   shown.      The  ten  problems  showed  each  of  the  five 
spacing  ratios,    mentioned  on  the  previous  page  (and  exhibited  in  Appendix  A) 
with  either    A  +  B   >     10    and     B  +  C    <    10    or  with    A  +  B    <    10    and 
B  +  C   >     10.     Subjects  were  shown  a  card  with  one  sample  problenn  which 
used  a  cross  multiplication  sign  and  one  problem  which  used  a  dot  multipli- 
cation sign.     Each  student  was  asked  if  he  or  she  was  familiar  with  both  the 
dot  and  cross  signs.      Less  than   25%    had  never  used  the  dot  before.      These 
students  were  told,    "This  sign  means  exactly  the  same  thing  as  the  cross 
multiplication  sign."     All  students  were  able  to  solve  the  two  sample  problems 
without  further  aid.     None  of  the  students  who  stated  that  they  had  never  used 
the  dot  multiplication  sign  before  showed  any  difficulty  in  understanding  the 
function  of  the  dot  either  on  the  sample  or  on  subsequent  problems.     The    40 
problems  in  Appendix   A   were  shown  in  the  indicated  order  to  each  of  the  stu- 
dents.    It  should  be  noted  that  for  individual  problems  of  this  type  any  rule 
followed  by  the  student  can  lead  to  one  of  only  two  possible  orders  of  operation. 


Answers  obtained  by  either  of  the  two  possible  orders  of  operation  for  a  given 
problem  were  accepted,    provided  that  no  error  was  made  in  any  of  the  compu- 
tations.    Where  errors  were  due  to  incorrect  multiplication  or  addition  or  to 
misreading  of  operation  signs,    the  error  type  was  determined  (by  questioning 
the  student  where  necessary)  and  recorded.      The  subject  was  then  asked  to  "try 
again"   or  "look  at  the  problem  a  little  more  carefully"   until  one  of  the  two 
acceptable  answers  was  given. 

Results 
One  advantage  in  noting  all  errors  was  a  demonstration  of  the  confusion 
resulting  from  use  of  the  cross    (x)    multiplication  sign.     In  the  total  of    15Z0 
problems  solved  by  the    38    subjects  there  were    Z7  3    errors  due  either  to  incorrect 
multiplication  and  addition  or  to  misreading  the  problem.     About    53%    (145)    of 
all  the  errors  were  due  to  errors  in  multiplication  or  addition  while  about   47% 
(128)    of  them  were  due  to  one  of  three  types  of  reading  errors.      Table    1    shows 
these  reading  errors  and  the  relative  number  of  errors  when  a  dot  or  a  cross 
multiplication  sign  was  used.      The  difference  is   significant  in  favor  of  the  dot 
(X^   =    7.61,    df   =    Z,    P   <     .025). 

Error  Dot  Cross        Total 


Multiplication  sign  read  as  addition  sign 
Addition  sign  read  as  multiplication  sign 
Multiplication  and  addition  signs  transposed 

Table    I 


Frequencies  of  Reading  Errors 


13 

23 

36 

22 

30 

52 

14 

26 

40 

49 

79 

128 

Source  df  MS 


M 

1 

1.27 

7.65 

>.25 

S 

4 

.09 

.54 

>.25 

O 

I 

86.21 

510. 

<.05 

D 

1 

.38 

2.28 

>.25 

M 

xS 

4 

.33 

1.99 

>.25 

M 

X  O 

I 

.  18 

1.08 

>.25 

M 

X  D 

1 

.  13 

.78 

>.25 

S 

X  O 

4 

4.  13 

24.8 

<.005 

S 

X  D 

4 

.  13 

.78 

>.25 

O 

X  D 

1 

.04 

.24 

>.25 

M  X  S  X  O 

4 

.18 

1.08 

>.25 

M  X 

S  X  D 

4 

.  12 

.72 

>.25 

S   X 

O  X  D 

4 

.02 

.  12 

>.25 

O  X 

D  X  M 

1 

.31 

1.81 

>.25 

M  X  S  X  O  X  D 

4 

.22 

1.32 

>.25 

within 

1480 

.167 

Total  1519 

Table    2 
Results  of  Analysis  of  Variance 

An  analysis  of  variance  was  performed  on  final  responses.     The  results  of 
this  analysis  are  given  in  Table    2,    where  factor     M    is  the  type  of  nnultiplication 
sign  used,     S    is  the  spacing  ratio,  O   is  the  order  in  which  the  addition  and 
multiplication  signs  were  placed,    and    D   is  relative  difficulty.      The  measure 
used  for  the  spacing  ratio  was  chosen  so  as  to  retain  information  on  both  the 
magnitude  and  the  direction  of  the  space,    i.e.,    to  allow  discrimination  between 
the  effects  of  the  larger  space  being  to  the  left  as  opposed  to  the  right,    of  the 
middle  numeral.     Magnitude,    per  se,    of  the   ratio  is  not  related  to  this  measure 
since  the  factorial  design  balances  out  magnitude  effects  except  in  interactions. 


The  order  of  placement  of  signs,    the    O   factor,    was  found  to  be  significant. 
Examination  of  the  data  indicates  that  this  may  be  interpreted  to  mean  that  the 
order  of  placement  of  signs  was  ignored  by  a  significant  portion  of  the  group; 
that  is,    some  students  worked  the  problems  by  consistently  performing  the 
leftmost  or  rightmost  operation  first     without  regard  for  whether  it  was  an 
addition  or  a  multiplication.      The    S  X  O    interaction  was  highly  significant. 
Examination  of  the  data  in  this  case  indicates  that  the  tendency  of  the  group  to 
perform  operations  in  a  set  direction  (left-to-right   or    right-to-left)  was  differ- 
entially affected  by  the  relative  size  of  the   spaces  between  numerals.      That  is, 
there  was  a  greater  tendency  for  the  group  as  a  whole  to  work  from  left  to  right 
when  the  space  on  the  left  was  the  smaller  than  to  work  from  right  to  left  when 
the  space  on  the  right  was  the  smaller. 

In  order  to  examine  the  effect  of  the  magnitude  of  the  spacing  ratio  alone 
it  is  necessary  to  examine  responses  to  individual  items.     If  we  predict  that 
the  operation  between  the  two  closest  numerals  will  be  performed  first,    we  can 
enumerate  the  number  of  student  responses  which  meet  or  fail  to  meet  this 
prediction.     Even  in  the  case  of  equal    (1:1)    spacing  more  "empty"    space  is 
left  around  a  dot  than  around  a  plus   sign  and,    in  turn,    more  around  a  plus  sign 
than  around  a  multiplication  cross  of  the  size  used  in  this  experiment.     This 
variation  in  "empty"   space  allows  us  to  make  predictions  even  for  the    1  :  1 
cases.      Table    3    shows  the  results  of  the  testing  of  these  predictions  with  the 
data  from  this   study.     Wide  and  moderate  spacing,    in  both  cases  easily  dis- 
cerned as  being  unequal,    lead  to  highly  significant  effects,    and  even  equal 
spacing  with  variations  in  amounts  of  open  space  between  operation  symbols 
and  numerals  has  a  moderately  significant  effect. 


Spacing  %    in  Predicted  j(^(ld.f.) 

ratio  Direction 


64 

47.5 

57 

11.6 

56 

Table    3 

4.8 

7:3  64  47.5  <.001 

3:2  57  11.6  <.001 


1:1  56  4.8  < .05 

Table    3 

Effect  of  Spacing  on  Order  of  Operations 

Students  almost  always  worked  the  problems  in  a  straightforward  fashion 
without  pauses   such  as  would  have  been  expected  had  they  been  considering  the 
difficulty  of  the  second  computation  in  choosing  which  to  do  first.     Moreover, 
an  analysis  of  the  second  computations  required  showed  no  evidence  that 
students  favored  the  order  which  would  make  the  second  operation  easier.    (The 
response  data  are  presented  in  Appendix    B.) 

If  rules  possibly  used  by  individuals  are  noted  for  the  first  and  last  ten 
problems,    it  is  found  that  five  different  rules   can  account  for  the  behavior  of 
32    of  the    38    subjects  in  the  experiment.     Table    4    shows  the  number  of  subjects 
using  the  various  rules  stated  in  terms  of  the  operation  performed  first. 


Operation  performed  first 

Multiplication 
Leftmost  operation 
Closest  spaced 
Addition 
Rightmost  operation 


Order  of  Operation  Rules  Assumed  Used 


Used  on  first 

Use 

d 

on  last 

ten  problems 

ten 

P 

roblems 

8 

12 

7 

12 

0 

5 

0 

2 

0 

1 

Table    4 

The  criterion  for  assumption  that  a  given  rule  was   being  used  was  the  production 
of  the   solution  predicted  by  that  rule  for  nine  or  ten  of  the  ten  problems  exam- 
ined.     The  binomial  probability  of  such  an  occurrence   by  chance  alone  is     .012. 
The   rules  "multiplication  first"   and  "leftmost  operation  first"   were  the  inost 
popular  for  the  problems.     Since  some  of  these  students  had  been  exposed  to  the 
convention,    the  data  given  in  Table    4    should  not  be  regarded  as  indicative  of  the 
preferences  to  be  expected  from  completely  naive  subjects.      What  should  be 
noted  is  the  relative  dominance  of  these  two  rules  and  the  tendency  for  the 
subjects  to  follow  consistent  rules  of  order  at  the  end  of  a  large  block  of  prob- 
lems even  when  they  did  not  do  so  at  the  outset.     In  addition,    subjects  appeared 
to  attack  problems  more  confidently  as  they  became  practiced.      Consistent  use 
of  rules   could  be  interpreted  as  being  the   result  of  learning  about  the  general 
task  which  allowed  use  of  "  shortcuts  .  "     Such  "  shortcuts"    should  not  be  con- 
fused with  effects  of  practice  on  a  basic  skill.      They  are  learned  patterns  of 
organizing  previously  known  skills  and,    as   such,    enable  a  subject  to  do  a  task 
for  which  a  pattern  exists  in  a  more  eff-icient  manner  than  if  he  possessed  only 
the  individual  skills  necessary. 

Conclusions 

Evidence  was  obtained  in  favor  of  using  the  dot  multiplication  sign  rather 
than  the  cross  sign.  The  number  of  errors  of  interpretation  was  significantly 
higher  for  the  cross  multiplication  sign. 

It  was  determined  that  there  is  a  significant  tendency  for  subjects  to  perform 
arithmetic  operations  in  a    left-to-right   order.     While  large  spacing  differences 
produced  significant  changes  in  operation  orders,    smaller  differences  and  mod- 
erate   term-by-term    differences  in  difficulty  had  little  or  no  effect  on    order- 
of-operations    behavior.     When  large  spacing  differences  exist,    a  significant 
interaction  between  the    left-to-right   or    right-to-left    rule  and  spacing  is  found. 
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APPENDIX   A 

A  complete  list  of  expressions  used  in  this  experiment.     Itenn  numbers 
correspond  to  the   rows  in  APPENDIX    B. 


21.  2X3    +    8 

22.  9+6-3 

23.  4+5     •     7 

24.  3X6  +  8 

25.  8   +    5X2 

26.  2+5X9 

27.  9X7  +  3 

28.  2    X    5+9 

29.  8  +  4-5 

30.  7     -     5+4 

31.  2    +    6-9 

32.  8    -    3+5 

33.  2X6  +  9 

34.  5  +  7X3 

35.  2   +   8-9 

36.  3     •     4+7 

37.  9-6    +    2 

38.  6X7    +     2 

39.  9    +    4-2 

40.  3+6    X    5 


1. 

3-7  +  9 

2. 

9    +    4X2 

3. 

3  +  7   X   8 

4. 

6x8+2 

5. 

4-6   +    7 

6. 

7+4    X    3 

7. 

4    +     3X9 

8. 

7    X    6+3 

9. 

2-8+5 

10. 

5   +    6-2 

11. 

6  +  4-9 

12. 

5-3    +    9 

13. 

8  +  6X4 

14. 

2   +    4X7 

15. 

9-3    +    4 

16. 

8X4   +    6 

17. 

4X5    +    7 

18. 

8+7      -     2 

19. 

2  +  7     -    8 

20. 

9-2+5 

APPENDIX    B 
Data  on  order  of  operations 

Multiplication  first  is  scored    1    and  addition  first  is   scored   0. 
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ITEM 
NO. 

SUBJECTS 

I      Z 

3 

4 

5 

6 

7 

8 

9     10    11 

12 

13 

14    15    16 

17 

18 

19 

2( 

1 

L       1 

1 

1 

1 

1 

1 

1     ] 

1 

1 

1       ] 

1 

1 

1 

1 

1 

2 

L      0 

1 

1 

0 

1 

0 

0      ] 

0 

1 

1       ] 

L       1 

1 

1 

1 

1 

3 

L      0 

0 

0 

0 

0 

1 

0 

0      ] 

0 

0 

0      ] 

0 

0 

0 

0 

0 

4 

L       1 

1 

1 

1 

1 

1     ] 

0 

1 

1     ] 

L              1 

1 

0 

1 

0 

5         ] 

L       1 

1 

1 

1 

0 

1     ] 

1 

1 

1     ] 

L       1 

1 

1 

1 

0 

6         ] 

L      0 

0 

0 

0 

0 

0 

0      ] 

[      0 

0 

0 

0      ] 

L       0 

0 

0 

0 

0 

7 

L      0 

1 

1 

0 

1 

0      ] 

0 

0 

1     ] 

1 

1 

1 

1 

1 

8         ] 

L       1 

0 

1 

1 

0 

1     ] 

1 

1 

0      ] 

L       1 

0 

1 

1 

0 

9 

L       1 

0 

1 

1 

0 

1     ] 

1 

1 

1     ] 

L       0 

0 

1 

1 

0 

10         ] 

L      0 

1 

0 

0 

0 

0 

0      ] 

L       0 

0 

0 

0      ] 

L       0 

0 

0 

1 

0 

11         ] 

I      0 

0 

0 

0 

0 

0 

-0      1 

L       0 

0 

0 

0      ] 

L       0 

0 

0 

0 

0 

12         ] 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

1 

1 

1 

1 

0 

13         ] 

L      0 

0 

0 

0 

0 

0      ] 

0 

0 

0      ] 

L       0 

0 

0 

0 

0 

14         ] 

I      0 

1 

1 

0 

1 

0      ] 

0 

0 

0 

0      ] 

L       1 

0 

0 

0 

0 

15          1 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L       1 

1 

1 

0 

16         ] 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L       1 

1 

1 

0 

17         ] 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L      1 

1 

1 

0 

18         ] 

L      0 

0 

0 

0 

0 

0 

0      ] 

0 

0 

0      ] 

L      0 

0 

0 

0 

19         ] 

L      0 

0 

0 

0 

0 

0 

0      ] 

L      0 

0 

0 

0      ] 

L       0 

0 

0 

0 

20         ] 

L       1 

0 

0 

1 

1 

0 

1     ] 

1 

1 

1     ] 

L       0 

1 

1 

0 

21         ] 

I       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L       1 

1 

1 

0 

22         ] 

L      0 

0 

0 

0 

0 

0 

0 

0      ] 

0 

0 

0      ] 

L      0 

0 

0 

0 

23         ] 

L      0 

0 

0 

0 

0 

0 

0 

0      ] 

0 

0 

0      ] 

[      0 

0 

0 

0 

24         ] 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L       1 

1 

1 

0 

25          ] 

I      0 

1 

1 

1 

1 

0      ] 

0 

0 

0      ] 

L       1 

1 

0 

0 

26         ] 

L      0 

1 

0 

1 

0 

1 

0      ] 

0 

0 

0      ] 

L       1 

0 

1 

0 

0 

27         ] 

L       1 

1 

1 

1 

1 

1-    ] 

1 

1 

1     ] 

L       1 

1 

1 

0 

28         ] 

L       1 

0 

0 

1 

1 

0 

0 

1     ] 

1 

1 

1     ] 

L       0 

0 

1 

0 

29         ] 

L      0 

0 

0 

0 

0 

0      ] 

L      0 

0 

0 

0      ] 

[       0 

0 

0 

0 

0 

30         ] 

L       1 

0 

0 

0 

0 

0 

1     ] 

1 

1 

1     ] 

[      0 

0 

1 

0 

31         ] 

L      0 

1 

1 

0 

1 

0      ] 

L      0 

0 

0 

0      ] 

L       1 

0 

1 

0 

0 

32         ] 

L       1 

0 

1 

1 

0 

1     ] 

1 

1 

1     ] 

L       0 

0 

1 

0 

33         ] 

L       1 

0 

1 

1 

0 

1     ] 

1 

1 

1     ] 

L      0 

0 

0 

0 

34         ] 

L      0 

0 

0 

0 

0 

0      ] 

L      0 

1 

0 

0      ] 

i       1 

0 

1 

0 

0 

35         ] 

L      0 

1 

0 

1 

0 

1 

0      ] 

0 

0 

0      ] 

L       1 

1 

0 

0 

36         ] 

L       1 

0 

0 

0 

0 

1     ] 

1 

1 

1     ] 

[      0 

0 

0 

0 

37          ] 

L       1 

1 

1 

0 

1 

1     ] 

1 

1 

1     ] 

L      0 

0 

0 

0 

38         ] 

L       1 

1 

1 

1 

1 

1     ] 

1 

1 

1     ] 

L       1 

1 

0 

0 

39          ] 

L      0 

1 

1 

1 

1 

0      ] 

L      0 

0 

0 

0      ] 

I    ■  1 

0 

1 

0 

0 

40          ] 

L      0 

0 

0 

0 

0 

0 

0      ] 

L      0 

0 

0 

0      ] 

L      0 

0 

0 

1 

0 

12 


APPENDIX    B.      Data  on  order  of  operations     (concluded) 


ITEM 
NO. 

SUBJECTS 

Zl  11    Z3  Z4 

Z5 

Z6  Z7  Z8 

Z9 

30  31  3Z 

33 

34 

35 

36 

37  38     2x 

1 

L   1   ] 

I   1 

1 

1   1 

I     1 

1 

1   ] 

1 

1 

1 

1 

1 

1   ] 

38 

2      ] 

L   1 

0 

1 

0 

[   0 

1 

0   ] 

L   1 

0 

0 

1 

0 

1   ] 

26 

3 

I   0 

I   0 

0 

0   1 

L   0 

1 

0   1 

0 

0 

0 

0 

0 

0   1 

L      10 

4      ] 

L   1   ] 

1 

1 

1 

1     ] 

0 

1 

1 

0 

1 

0   ] 

L      32 

5     ] 

L   1   1 

1 

1 

1 

1     ] 

I  1 

1 

1 

1 

1 

1  ] 

36 

6 

i   0 

0 

0 

0 

0 

0 

0   ] 

I   0 

0 

0 

0 

0 

0   ] 

y          9 

7      1 

I   1   ] 

0 

1 

0   ] 

L   0 

0 

0   ] 

I   0 

0 

0 

1 

0 

1     ] 

L      24 

8 

L   1   1 

0 

1     1 

1 

1  ] 

[   0 

1 

1 

0 

1 

0   1 

L      29 

9 

L   1 

0 

1     ] 

1 

1  ] 

[  1 

1 

1 

0 

1 

1     ] 

I      31 

10 

L   0   ] 

L   0 

0 

0   ] 

I   0 

0 

0   ] 

L   0 

0 

0 

1 

0 

0   ] 

L      12 

11      ] 

L   0   ] 

L   0 

0 

0 

[   0 

0 

0   1 

I   0 

0 

0 

0 

0 

0   ] 

L      9 

IZ 

I   1   1 

1 

1  ] 

1 

1  ] 

I     1 

1 

1 

1 

1 

1     ] 

L      37 

13      ] 

L   0   ] 

0 

0 

0   ] 

0 

0 

0   ] 

[   0 

0 

0 

0 

0 

0   ] 

L      10 

14      ] 

L   1   ] 

0 

0 

0   ] 

I   0 

0 

0   ] 

I   0 

0 

0 

1 

0 

0 

I     16 

15 

[   1   ] 

1 

1  ] 

1 

1 

I  1 

1 

1 

1 

1 

1     ] 

L      37 

16     1 

I   1   ] 

0 

1     ] 

1 

1  ] 

L   1 

1 

1 

1 

1 

0   ] 

L      35 

17 

L   1   ] 

1 

1  ] 

1 

1  ] 

L   1 

1 

1 

1 

1 

1 

I      37 

18      ] 

L   0   ] 

L   0 

0 

0   ] 

L   0 

0 

0   ] 

L   0 

0 

0 

1 

0 

1     ] 

L      11 

19      ] 

L   0   ] 

L   0 

0 

0   ] 

L   0 

0 

0   ] 

L   0 

0 

0 

1 

0 

0   ] 

I      10 

ZO      ] 

I   1   ] 

0 

1  ] 

1 

1     ] 

L   1 

1 

1 

0 

1 

1     ] 

L      31 

Zl 

I   1   ] 

1 

1     ] 

1 

1  ] 

L   1 

1 

1 

1 

1 

0   ] 

L      35 

ZZ      ] 

L   0   ] 

[   0 

0 

0   ] 

L   0 

0 

0   ] 

I   0 

0 

0 

1 

0 

0   ] 

L      9 

Z3      ] 

L   0   ] 

[   0 

0 

0   ] 

L   0 

1 

0   ] 

L   0 

0 

0 

0 

0 

0   ] 

I      9 

Z4      ] 

L   1   ] 

0 

1  ] 

1 

1  ] 

L   1 

1 

1 

1 

1 

1  ] 

L      36 

Z5      ] 

I   1   ] 

I   0 

1 

0   ] 

I   0 

1 

0   ] 

L   0 

0 

0 

1 

0 

1  ] 

[      21 

Z6      ] 

L   0   ] 

I   0 

1 

0   ] 

L   0 

0 

0   ] 

I   0 

0 

0 

1 

0 

0   ] 

L      16 

Z7 

I   1   ] 

0 

1     ] 

1 

1     ] 

L   1 

1 

1 

1 

1 

1  ] 

I      36 

Z8      ] 

L   0   ] 

0 

1 

1 

1     ] 

L   1 

1 

1 

1 

1 

1     ] 

L      29 

Z9      ] 

L   0   ] 

L   0 

1 

0 

0 

1 

0   ] 

I   0 

0 

0 

1 

0 

1     ] 

I      14 

30 

L   0   ] 

0 

1  ] 

0 

1  ] 

I   0 

1 

1 

0 

0 

0   ] 

L      23 

31 

[   1   ] 

0 

1 

0   ] 

0 

0 

0   ] 

I   0 

0 

0 

1 

0 

0   ] 

L      18 

3Z 

I   0   ] 

0 

1 

1 

1  1 

I   0 

1 

1 

0 

1 

1     ] 

I      29 

33 

L   1   ] 

0 

1 

1 

1  ] 

L   0 

1 

1 

1 

1 

1  ] 

L      30 

34 

L   1 

1 

0   ] 

L   0 

1 

0   ] 

i   0 

0 

0 

1 

0 

0   ] 

L      18 

35 

L   1 

0 

1 

0   ] 

L   0 

1 

0   ] 

L   0 

0 

0 

1 

0 

1  ] 

I     19 

36 

L   1 

0 

1 

0 

1 

I   0 

1 

1 

1 

1 

1     ] 

I      27 

37 

I   1 

1 

1 

1 

1  ] 

I   1 

1 

1 

1 

1 

0   1 

[      32 

38 

L   1 

1 

1 

1 

1 

L   1 

1 

1 

1 

1 

1  1 

L      36 

39 

I   1 

L   0 

1 

0 

L   0 

1 

0   ] 

I   0 

0 

0 

1 

0 

1 

I      21 

40 

I   0 

I   0 

0 

0 

L   0 

0 

0 

I   0 

0 

0 

1 

0 

1     ] 

[      12 
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